A Data Augmentation Approach for Sign-Language-To-Text Translation In-The-Wild

In this paper, we describe the current main approaches to sign language translation which use deep neural networks with videos as input and text as output. We highlight that, under our point of view, their main weakness is the lack of generalization in daily life contexts. Our goal is to build a state-of-the-art system for the automatic interpretation of sign language in unpredictable video framing conditions. Our main contribution is the shift from image features to landmark positions in order to diminish the size of the input data and facilitate the combination of data augmentation techniques for landmarks. We describe the set of hypotheses to build such a system and the list of experiments that will lead us to their verification

Ontological domain coding for cultural heritage mediation

Abstract. An ontology-based representation of information about a domain is flexible enough to support different strategies in presenting the information. In this paper, we present two applications for creating interactive presentations in a cultural heritage domain, that share the same database of informative units and the same representation of the domain, encoded in a light-weight ontology. An application for drama-based guided tours assembles the informative units in a location-aware fashion, by exploiting the structure of the ontology to enforce the notion of discourse focusing in the generated presentation. A browsing-based application for accessing the informative units supports semantic search, consulting the ontology to suggest modifications of the user's search to circumscribe or enlarge the result sets

Towards social embodied cobots: The integration of an industrial cobot with a social virtual agent

The integration of the physical capabilities of an industrial collaborative robot with a social virtual character may represent a viable solution to enhance the workers' perception of the system as an embodied social entity and increase social engagement and well-being at the workplace. An online study was setup using prerecorded video interactions in order to pilot potential advantages of different embodied configurations of the cobot-avatar system in terms of perceptions of Social Presence, cobot-avatar Unity and Social Role of the system, and explore the relation of these. In particular, two different configurations were explored and compared: the virtual character was displayed either on a tablet strapped onto the base of the cobot or on a large TV screen positioned at the back of the workcell. The results imply that participants showed no clear preference based on the constructs, and both configurations fulfill these basic criteria. In terms of the relations between the constructs, there were strong correlations between perception of Social Presence, Unity and Social Role (Collegiality). This gives a valuable insight into the role of these constructs in the perception of cobots as embodied social entities, and towards building cobots that support well-being at the workplace